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TITLE: System and methods 

for querying digital image archives 
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Brief Summary Text - BSTX (5) : 

In general, owners of multimedia archives 
are continuously seeking to 
improve the management and search 
capabilities of their archives in order to 
make it easier for users of such archives to 
retrieve desired information. In 
particular, it would be useful to be able to 
query a multimedia archive 
comprised of digital images (e.g., 
photographs or video sequences) by 
specifying certain parameters which are 
recorded on the digital images such as 
names of geographic locations, altitude, 
longitude, time and/or date, and 
searching the contents of the archive to 
retrieve every digital image having 
the specified parameters. By way of 
example, in order to relive the experience 
of escaping a cold winter in the northeast 




US -PAT-NO: 



6366311 



DOCUMENT - I DENT I F I ER : 



US 6366311 Bl 



TITLE: 

system for aircraft 



Record and playback 



KWIC 



Brief Summary Text - BSTX (11) : 

The subject invention is directed to a 
recording and playback system wherein 
multiple data and images are multiplexed and 
sequenced utilizing split screen 
technology in order to minimize the 
recording and monitoring hardware required 
to process the images in order to provide a 
detailed record of the time of an 
event, the altitude and geographic location 
of the aircraft and the type and 
location of the event within the aircraft, 
greatly enhancing event 

reconstruction efforts. The system is a 
comprehensive multi -media safety and 
surveillance system, which in the preferred 
form provides both visual and audio 
information as well as critical data to the 
flight crew, and to a ground 

tracking station, and also permits recording 

the information and data generated 

during flight for archival purposes and for 
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position/ image digital recording and 

display system 
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Brief Summary Text 

In Honda, U.S. 
there is disclosed 
camera w 



- BSTX (7) : 

Pat. No. 5,296,884, 

a data recording 



referred to as geo-addressing . 



Detailed Description Text - DETX (11) : 

The recording unit 102 also includes a 
recording controller 181 which is 
provided with suitable control and data 
connections means (not shown) to and 
from the GPD 110, the GPDR 130, the optical 
system 160, the audio pickup device 
172 and the IRD 180 for controlling the 
sequence and timing of the capture and 
recording of the system 102 position at the 
time of capture and recording of 
the object image 150 and audio data Af . 
Means may also be provided for 
recording the time, Ti, of the capture of 
the image 150 as image data, If, 
which is associated with the geographical 
location, Li, determined at the time, 
Ti, therewith. The digital object image 
data 170, and the digital audio data 
174 is automatically geo-addressed to the 
position where the image 150 was 
captured. The digital object image data 170 
and digital audio data 174 thus 
may be stored with reference to a 
geo-addressed map during later playback as 
described below. 



Detailed Description Text - DETX (26) : 
In operation, a user wo 
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Detail Description Paragraph - DETX (62) : 

[0086] The range and image data collected 
from the above described optical 
systems is correlated with position and 
orientation data (hereinafter POS 
data) , wherein the POS data is used to 
transform the range image data to its 
exact geographic coordinate . The POS data 
is collected by a POS device, 
wherein said POS device comprises a global 
positioning system ( GPS) , wherein 
said GPS is tightly coupled to an inertial 
measurement unit (IMU) . The 
coupling of the GPS to the IMU allows the 
POS device to correct the data 
collected from said device, wherein the 
effects of aircraft vibration and 
motion are factored into the positioning of 
the POS device. Kalman filtering 
techniques are used to correct the POS data. 

The POS device can be any 
position and orientation sensor device which 
functions detect the three 
rotation angles relative to the three axes 
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Abstract Paragraph - ABTX (1) : 

A system and method synthesizing i 



he imagery being depicted. 

Summary of Invention Paragraph - BSTX (9) : 

[0008] Accordingly, there is a need for a 
system and method for creating a 
visual database of a comprehensive 
geographic area in a more time and cost 
efficient manner. Such a system should not 
require the reconstruction of 3D 
scene geometry nor the dense sampling of the 
locale in multiple dimensions. 
Furthermore, the images in the database 
should provide a wider field of view of 
a locale to provide context to the objects 
being depicted. The database should 
further correlate the images with additional 
information related to the 
geographic location and objects in the 
location to further enhance the viewing 
experience . 
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Summ 




tween image data and position data 
corresponding to the location of the object. 



Detail Description Paragraph - DETX (30) : 

[0052] The position data correlated with 
each image acquired by the image 
acquisition stage 12 can be acquired at the 
time of image capture, or the 
position data can be acquired or updated 
after the image is acquired. The 
position data can be acquired at a selected 
time after image capture by- 
acquiring an available and suitable GPS 
signal with a GPS receiver mounted 
either in the image acquisition stage 12 or 
at another secondary location, such 
as in the storage and control stage 20. 
Alternatively, the captured or 
acquired image data can be temporarily 
stored at the image acquisition stage 12 
for a time sufficient for the receiver 36 to 
receive position signals 

corresponding to the geographical position 

of the object. Once the position 

and image data are acquired, the image and 

position data can be transferred to 

the storage and control stage 2 0 for further 

processing . 

Detail Description Paragraph - DETX (32) : 
[0054] FIG. 4 is a schematic flowchart 
diagram illustrating the b 
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Brief Summary Text - BSTX (2) : 

The present invention relates generally 
to the field of geographical 
information systems. The present invention 
relates particularly to correlating 
geographical information from a global 
positioning system with images that are 
recorded by a portable video recording 
device . 



Brief Summary 



